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battery to Employment Service staff and employers in selecting 
individuals for training in Customer-Service Representative 
positions. Research demonstrated a statistically significant and 
useful relationship between proficiency as a Customer-Service 
Representative and the SATB. The SATB can be expected to produce a 
useful increase in the proportion of highly proficient workers. When 
the SATB was applied to the validation sample, composed of 
individuals who were employed and therefore considered competent, an 
increase from 67 percent to 75 percent in the proportion of highly 
proficient workers was found. A greater increase can be expected when 
the battery is used with applicants, bacause the range of relevant 
abilities is wider among applicants than among employed workers. The 
report includes: (1) research sumMry; (2) procedure; (3) analysis; 
and (4) validity of the battery. Descriptive statistics for subgroups 
of the validation sample, descriptive rating scale, and job 
description are contained in the appendices. (Author/PN) 
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RESEARCH SUMMARY 



This report is designed to provide the information required to evaluate the 
Specific Aptitude Test Battery (SATB) for Customer-Service Representative 
from three points of view: (1) technical adequacy of the research; (2) 
- fairness to minorities; and (3) usefulness of the battery to Employment 
Service staff and employers in selecting individuals for training in 
Customer-Service Representative positions. 

Research demonstrated a statistically significant and useful relationship 
between proficiency as a Customer-Service Representative and the following 
Specific Aptitude Test Battery: 



The validation sample, on which the SATB was developed, consisted of 404 
employed workers from 15 states and the District of Columbia. Analysts 
collected data for 126 subjects during the period of 1971-1975. Data for an 
additional 278 subjects were collected from 1977-1980. Statistical evidence 
justified combining the two groups into one aggregate sample. The black 
subgroup for the total sample consisted of 81 subjects. The tests used were 
those of the General Aptitude Test Battery (GATB). Job proficiency was 
measured by supervisory ratings. 

Test research analysts found no evidence of difference in validity between 
blacks and nonminori ties; the battery proved to be fair to blacks and 
nonminorities using several definitions of fairness. Additional information 
is presented in the Validity of the Battery section and in Appendix 1. The 
difference in validity between males and females was not statistically 
significant. 

The SATB can be expected to produce a useful increase in the proportion of 
highly proficient workers. When the SATB was applied to the validation 
sample, composed of individuals who were employed and therefore considered 
competent, an increase from 67% to 75% in the proportion of highly proficient 
workers was found. A^ greater increase can be expected when the battery is 
used with applicants, because the range of relevant abilities is wider among 
applicants than among employed workers. 



Aptitudes 



Cutting Scores 



N - Numerical Aptitude 
Q - Clerical Perception 



95 
105 
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PROCEDURE 

A concurrent design was used for the validation study; test and criterion 
data were collected at about the same time at each of the separate employment 
sites over a period from 1971 to 1980, 

Job Analysis 

A job analysis was done by observing the workers' performance on the job and 
by consulting with supervisors. Analysts prepared a job description based on 
the job analysis. This description was used to select an experimental sample 
of employed Customer-Service Representatives and to choose an appropriate 
criterion or measure of job performance. 

Job duties of workers at each location listed in ACKNOWLEDGMENT were compared 
with the job description and found to be essentially the same. If minor 
differences were found, the job description was modified. The job 
description shown in Appendix 3 is the result of this process and may be used 
to provide information on the applicability of the test battery resulting 
from this research. 

Each job duty was rated for frequency of performance, percentage of time 
spent, and level of difficulty. Critical job duties were identified on the 
basis of these ratings. 

At least one analyst at each location rated the aptitudes as irrelevant, 
important, or critical to performance of the job duties at that location. A 
synthesis of these ratings and their rationale follows: 



G - General Learning Ability 



V - Verbal Aptitude 



Q - Clerical Perception 



K - Motor Coordination 



Required to understand communications 
from customers; to integrate 
information; and to make judgments as 
to type of action required to provide 
appropriate service. 

Required to communicate with customers 
in person, by telephone '^r correspon- 
dence for service, installation, dis- 
continuance, problem situations* and 
customer accounts. 

Required to retrieve and monitor data 
within strict tolerances; to copy data 
from record to record; to fill out 
forms; and to detect errors in 
statements. 

Required to operate keyboard while 
watching a computer terminal screen. 



Experimental Test Battery 

The experimental test battery for the validation sample consisted of all 12 
tests of the GATB, B-1002B, Information on the composition and developmental 
research of the GATB may be found in the Manual for the General Aptitude Test 
Battery, Section III , Development, avai lable from the Government Printing 
Offke, 
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yalidation Sample Description 

The validation sample consisted of 404 Customsr-Service Representatives (355 
females and 49 males) employed at various locations in the North, South, and 
West (See ACKNOWLEDGMENT). A total of 105 were minority group members (81 
blacks, 18 Hispanics, 2 American Indians, 2 Orientals, and 2 other 
nonminorlties) and 299 were nonminority group members. 

The means and standard deviations for age, education, and experience of 
sample members are shown in Table 1. 

Some sample members were test-selected with the Purdue Clerical Adaptability 
Test prior to selection. Although no employer required formal education 
beyond high school graduation, substantial attainment beyond high school was 
not uncommon in the nationwide sample. All workers had at least 6 month's 
experience on a job which has duties similar to those found in the job 
description in Appendix 3, Descriptive statistics for black and nonminority 
subgroups are shown in Appendix 1. 

Criterion for Validation Study 

The criterion for the validation sample consisted of supervisory ratings. 
Each subject was rated twice by a first line supervisor with an interval of 
two weeks between ratings, or once each by a first and second line 
supervisor. Since sample members* aptitude scores are confidential » 
supervisors had no knowledge cf test scores of workers. Thus, the 
possibility of these scores affecting ratings did not exist. 

A modified descriptive rating scale was used for 278 of the sample members. 
The scale (see Appendix 2) consists of 11 items. Ten of these items cover 
different aspects of job performance. The 11th is a global item on the 
"all-around" ability of a Customer-Service Representative. Each item has 
five alternative responses corresponding to different degrees of job 
proficiency. For the purpose of scoring items, weights of 1 to 5 were 
assigned to the responses. The total score on the rating scale is the sum of 
the weights for the eleven items. The possible range for each rating is 
11-55. The remaining 126 subjects were rated with the standard descriptive 
rating scale. Items A through E and K of the modified scale constitute all 
items of the standard scale. 

Through analyzing separate statistics produced by the subjects associated 
with each rating scale, researchers concluded that the two different scales 
produced no difference in relative performance of subjects. Therefore, 
criterion scores of all subjects were standardized to equate in magnitude 
with those of the 11-item modified descriptive rating scale. A review of the 
job description Indicated that the items included ir both scales were 
directly related to important aspects of job performance. 

A - Quantity of work: A Customer-Service Representative must provide service 
to as many customers as possible in order to maintain good customer 
relations and be a profitable resource to the company he or she 
represents. 

B - Quality of work: The work of a Customer-Service Representative must be 
of high quality to insure that customers are given as correct and 
complete information as possible and that information needed to install, 
Q change or discontinue service is recorded correctly. 
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C - Accuracy of work: A Customer-Service Representative must be able to 
quote correct rates and review all written forms for accuracy and 
completeness. 

D - Job knowledge: A Customer-Service Representative must pos-^ess 
comprehensive knowledge of service available and rating structures to 
answer all questions received by telephone or in person and to receive 
and record orders for installation and discontinuance or chai.>f in 
service. 

E - Job versatility: A Customer-Service Representative must be capable of 
performing a variety of duties to give the best possible service to 
customers. 

F - Knowledge of policies and procedures: A Customer-Service Representative 
must have knowledge of established policies and procedures supporting 
company policy. 

G - Knowledge of rate structure: A Customer-Service Representative must have 
a clear understanding of the company rate structure by type of service. 

H - Obtaining information: A Customer-Service Representative must have the 
ability to elicit all necessary information from customers. 

I - Working amidst distracting conditions: Although this is an environmental 
condition not explicitly stated in the Job Description, the majority of 
supervisors indicated that being able to function amidst distracting 
conditions was one trait that separated good Customer-Service 
Representatives from mediocre or poor Customer-Service Representatives. 

J - Efficient handling of inquiries: A Customer-Service Representative must 
have the ability to handle inquiries in person or by telephone with 
decisiveness and efficiency. 

K - Workers all-around job ability: A Customer-Service Representative's 
value to the employer involves a combination of the aspects of job 
performance listed above. 

A reliability coefficient of .84 was obtained between initial and follow-up 
ratings for the 278 subjects whose performance was measured by the modified 
scale. The relationship between initial and follow-up ratings for the 126 
subjects rated by the standard descriptive rating scale was .84. Therefore, 
the final job perfonnance criterion consists of standardized combined (sum of 
initial and follow-up ratings) scores, using as a base, the distribution of 
the combined scores of the 278 subjects. The possible range for the combined 
scores is 22-110. The actual range for the total sample is 33-110. The mean 
is 77.3 with a standard deviation of 15.7. Table 1 shows the relationship 
between the standardized job perfonnance criterion and age, education and 
experience. 
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TABLE 1 



Means, Standard Deviations (SD), and Pearson 
Product-Moment Correlations with the Criterion (r) for 
Age, Education and Experience 



Validation Sample 
N=404 



Mean 



SD 



r 



Age (years) 30.4 
Education (years) 12.8 
Total Experience (months) 57.0 



10.2 
1.4 
69.0 



.05 
-.03 
.22** 



**Sign1ficant at the .01 level 



For the purpose of analysis, researchers dichotomized the criterion 
distribution so as to include, as nearly as possible, one-third of the 
subjects in the low criterion group and two-thirds in the high criterion 
group. This procedure is the standard for SATB studies. A criterion cutting 
score of 68 placed 33% of the overall sarT^)le in the low criterion group and 
67% in the high criterion group. 



The initial step in SATB data analysis is to identify those aptitudes which 
show some evidence of validity and job relatedness. This evidence can be: 

1. Statistical evidence of the correlation (r) between the test and the 
criterion, 

2. Content validity as evidenced by a rating of "critical" based on job 
analysis, or 

3. Any combination of the following: 

- high mean 

- low standard deviation (SD) 

- rating of "important" based on the job analysis 

- demonstrated validity in a prior validation study. 
Statistical results for the validation sample are shown in Table 2. 



ANALYSIS 
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TABLE 2 

Statistical Results for Validation Sample 
N=404 





Aptitude 


Mean 


SD 


r 


G - 


General Learning Ability 


104.8 


15.8 


.24** 


V - 


Verbal Aptitude 


105.2 


15.1 


.18** 


N - 


Numerical Aptitude 


10S.3 


16.3 


.30** 


S - 


Spatial Aptitude 


103.2 


18.4 


.11* 


P - 


Form Perception 


116.3 


20.0 


.19** 


Q - 


Clerical Perception 


123.1 


15.6 


.15** 


K - 


Motor Coordination 


115.9 


15.8 


.06 


F - 


Finger Dexterity 


101.4 


21.5 


.11* 


M - 


Manual Dexterity 


105.4 


22.1 


.12* 



♦Significant at the .05 level. 
♦♦Significant at the .01 level. 

Table 3 summarizes the qualitative analysis and statistical results shown in 
Table 2 and shows the aptitudes considered for inclusion in the SATB. 



TABLE 3 

Summary of Qualitative and Quantitative Data 
for Validation Sample 



Type of Evidence 



Job Analysis Ratings 
Critical 
Important 

Irrelevant 

Statistical Evidence 
High Mean 
Low SD 

Significant r 

Aptitudes Considered for 
Inclusion in the Battery 



Aptitudes " 
G V N S > Q K F M 



X X X 
X X X X X X XX 
GVNSPQKFH 



The information In Table 3 Indicates that all nine aptitudes should be 
considered for Inclusion In the battery: G, V, N, S, P, Q. K, F, and M. The 
objective Is to develop a battery of 2, 3, or 4 aptitudes with cutting scores 
at the point (a) where about the same percent will meet the cutting scores as 
the percent rated In the high criterion group, and (b) which will maximize 
the relationship between the battery and the criterion. 
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The cutting scores are set at about one standard deviation below the mean 
aptitude scores of the sample, with deviations at five point intervals above 
and below these points to achieve the objectives stated above. 

The following battery resulted: 

Aptitudes Cutting £ccrcs> 

N - Numerical Aptitude 95 
Q - Clerical Perception 105 

Although standard qualitative analyses did not reflect aptitude N as either 
"critical" or "Important," statistical evidence shows this aptitude to be 
important to the job. A review of the job description (Appendix 3) shows 
that this aptitude is not contraindicated. 



VALIDITY OF THE BATTERY 

This section of the report first presents evidence of criterion-related 
validity of the SATB on the validation sample and all relevant subsan?)les. 
Next, it provides information on effectiveness and fairness of test norms. 

Criterion Related Validity 

Table 4 shows that there 1s a significant relationship between the job 
performance criterion and the SATB for the validation sample in aggregate and 
each of its identifiable ethnic subgroups. 



TABLE 4 
Validity of Battery 







High 
Criterion 
Group 


Low 
Criterion 
Group 




Signifi- 




Sample 


N 


Below 

Cutting 

Scores 


Meeting 
Cutting 
Scores 


Below 
Cutting 
Scores 


Meeting 
Cutting 
Scores 


Chi 
Square 


cance 
Level 
P/2< 


Phi 
Coeffi- 
cient 


Total 


404 


61 


210 


64 


69 


27.4 


.0001 


.26 


Black 


81 


17 


27 


24 


13 


5.5 


01 


.26 


Non- 
Minority 


299 


39 


175 


35 


5G 


17.2 


.0001 


.24 



As a further test of battery validity, analysts computed a multiple 
correlation coefficient for the total validation sample. An R of .30 
(significant at the .005 level) was obtained between the job performance 
criterion and Aptitudes N and Q. 
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E ffectiveness of the Battery 

the level of validity shown in Table 4 indicates that the SATB will be useful 
In selection. In the total validation sample 67^. were considered to be 
highly proficient. Of those who met the cutting scores, 75% were judged to 
be highly proficient. These findings are shown in Table 5. 

TABLE 5 

Effectiveness of the Battery 



Selection 
System 


Number 
Selected 


Highly 
Proficient 

(High 
Criterion 
Group) 


Marginal 

(Low 
Criterion 
Group) 


N 


% of 
Total 


N 


% of 
Total 


Validation Sample 












Without Tests 


404 


271 


67 


133 


.33 


With Tests 


279 


210 


75 


69 


.25 



The research sample consisted of employed workers on whom some selection had 
already taken place; presumably those workers who lacked the required 
abilities had quit, been terminated, or had been transferred. Therefore, a 
greater increase over existing selection methods in the proportion of highly 
proficient workers selected is to be expected when the battery is used for 
selection, because the range of relevant abilities is greater among 
applicants than among employed workers. 



Subgr oup Analysis ... r j x 

No dimrence in the validities for blacks and nonminorities was found for 

this battery; the difference between the phi coefficients for blacks and 
nonminorities is not statistically significant (CR=.18). 

The battery i' fair to blacks since the proportion of both blacks and 
nonainorities that met the cutting scores approximated the proportion who 
were in the high criterion group; 49% of the blacks met the cutting scores 
and 54% were in the high criterion group; 75% of the nonminorities met the 
cutting scores and 72% were in the high criterion group. 

The validity of the battery for the subgroup of 49 males was low. However, 
the difference between the phi coefficients for the male and female subgroups 
is not statistically significant (CR = 1.72). 
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APPENDIX 1 

Descriptive Statistics for Black and Nonminority 
Subgroups of Validation Sample 







Black 
{N-81) 




Nonminority 
(N=299) 




Variable 


Mean 


SO 


Range 


Mo An 


SD 


Range 


Aptitude G 


94.1 


14.0 


69-132 


inR 1 


1d Q 


66-149 


Aptitude V 


97.7 


12.6 


70-133 


1 n? t> 

lU/ . 3 


9 


65-160 


Aptitude N 


96.0 


14.4 


53-132 


lUO . J 


R 

1 ^ . o 


54-148 


Aptitude S 


92.7 


16.1 


65-130 


106.^ 


lo.U 


65-163 


Aptitude P 


109.2 


19.6 


71-157 


118.1 


19.6 


46-167 


Aptitude q 


119.4 


15.5 


86-152 


123.9 


15.4 


88-181 


Aptitude K 


118.4 


17.1 


78-163 


114.6 


15.4 


64-163 


Aptitude F 


98.0 


17.3 


54-137 


102.1 


22.6 


45-158 


Aptitude M 


104.5 


21.4 


43-154 


105.4 


22.6 


37-166 


Criterion 


73.5 


14.7 


35-110 


79.0 


15.6 


33-110 


Age 


27.9 


7.0 


18- 56 


31.4 


10.9 


18- 69 


Education 


12.8 


1.2 


12- 17 


12.8 


1.5 


8- 19 


Total Experience 


40.8 


33.6 


6-156 


61.8 


76.1 


6-490 



(ironths) 



ERIC 



DESCRimVE RATING SCALE 

SCORE 



RATING SCALE FOR 

DX).T. nut m4 God* 



DlffctkMs: FteaM rud ttit ^'SiiMNtiom to Rilm" and ^ flB in tiM itnrn whkii fbOov. In mikii^ your 
wHn p i only om bcx AouM bt ondud for mck fpmtlon. 

SUGGBSnONS TO RATERS 

1% m ukiM yoy to rate tht job pwfoniaiiot of tht p«opto wlio vork foryou. IHm rttimi wttl mw m 
a *>ara^*^ afriMt which w« can cofopara tir* taal acom » thia study. Ite ratii^ mutt |^ a tnia pktuit 
of aach workar or thia atudy wiU harva vary littk vahia. You iwuM try to |iva tht moat accurate ratii^ 
pomAk for aoch vorkor. 

Tbaaa ntlaii ai« ttrictly conMantial and won't af^ your worl»n m lay way. Ntithtr tha ntkm nor 
taat acorts of any worktit wii ha iMwn to anybody in your comniny. We art mttiastad only in^ttitini 
tha tests.*" Ritttift ai« n aa d a d only for thoaa worlm who art m tha ta« study. 

Worktrs who not complatad th^ trainjiit pariod. or who have not been on the job or undar your 
ai^ervision km enough for you to know how waO tiiey can perform this work should not be rated. 
Haaa inform the test techmcian ^>out this if you are to rate any such workers. 

Complete the Itit question on^ if the worker is no longer on the job. 

In makiiii ratinp, don*t let feneral impresaions or some outstandmc trait affect four judgment. Try to 
forgit your personal feelings about the worker. Rite only on the work performed. Heie are sooie more 
poinu which mi^t help you: 

1 . Aeaae lead aU dtiections and the rating scale thorou^y before rating. 

2. For each <^ieation compare yoitf workers with ^Vorkers-tn^neral" in this job. TYut is. coimwe your 
workers with other workers on this job that you have known. This is vsry important tn sinaK plvits 
where there are only a frw workers. We want the raimp to be btted on the tame stmlard in all the plants. 

3. A niggested method is to rate aO workers on one question at a time. The questions ask about different 
al^tin of the woikers. A worker may be good in one abibty and poor in Mother for exmple. a my 
slow worker may be accurate. So rate aU workers on the first question, then rate all workers on the second 
question, and so on. 

4. Practice and experience uauaUy im^ove a work«*s dial. However, one worker with wt montla* experisnce 
n»y be a better worker than amMher with sU years* experience. Don*t rate one worker u poorer thMi 
another merely because of a letter amoiat of experience. 

5. Rate the workers according to the work they haw done om a period of several weeks or months. Don*t 
rala^onthebasiaofone>ood**day.oroM*^"dayorsQme w^mddent. Thiik ki terms of 
eadi workar s uauai or typical parformanee. 

6. Rm only abitttiai hated on tha ratteg rftsaat. Do not let facton such as cooperati«tnesa« abiity to 
pt along w^ othm, p ro mpt n ssa and hoaaaty mfluenca your ratinp. Ahhoi^ these aspacu of a worker 
an k^ortent. they are of no nhie for thia study aa a 'VardstKk'* against which to compare wtitude 

leal acorea. 
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Cofiip«fiy Job Titk : 



How olttfi do you Mt thii wockti 
in a vofk litMUon? 



Hov long hivt you worktd with thii wofkw? 



□ Undtf ont month. 



□ Smnl tiiMs t 4ty. 

□ Smral timti a wttk. 



□ Ont 10 two monthi. 



□ Thm to fl>« months. 



□ Six months or mort. 




□ l.Cipabk^my tow work w^t. Cm ptrfovm only at an wisatitfictory pace. 

□ 2. C^Mt of tow work output. Can parform at a slow pact. 

□ 3. C^tbk of fail work output. Cm ptrfwm at tfi aoctplaM ptce. 

□ 4. C^^ of hi^ «ork output. Can ptrfofm ^ a fast pact. 

□ 5. apibte of very h# work output. Can ptrform at animusuaUy fut pace. 

B. How |ood is the quality of work? (Wwker's ability to do h#-|rade work which meets quaUty standards.) 

□ I . Performance is mferior and almost new meets minimum quality standards. 

□ 2. Performance » usually acceptable but somewhat inferior in quality, 

□ 3. Ptrformwce is acceptable but usually iH>t superior in quality. 

□ 4. Performance is usuaBy superm m qunlity. 

□ 5. Performwce is almost always of the lu#kest (^ty. 

C. How accurate is the woA? (Worker*s ability to avoid makmt mistakes.) 

□ 1. M^es very m»iy matakes. Work nMb constant checkint- 

□ 2. Makes frequent mi«akes. Work nee4s more checkinf than a desirable. 

□ 3 Makes nustakes occa»oftdiy. Work needs only mmnal checkii^. 

□ 4. Makes few mUtakes. Work seldom needs checkm|. 

□ 5. lUrely makes s mtstake Work shnoet never needs checking. 
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D. How mucfa does iKt worker know about the job? (Worker*! underttindinf of the pnncipks, equipment, matenait 
■id methods that ha^ to do directly or iadiiectly with the work.) 

O I. Has very limited knowkdfe. Does not know «nou|h to do the job adequately. 

□ 2. Hm little knowledfe. Knows enou|h to |et by. 

□ 3. Has moderate amount of knowMp. Knows enough to do fair work. 

□ 4. Haa broad knowledge. Know% enough to do good work. 

□ S. Htt complete knowledge. Knows thejob thoroughly 

E. How large t variety of job dutias can the worker perform efTioently? (Worker*! ability to htndle several different 
oper^ions.) 

□ I . Cmnot perform different operations adequately. 

□ 2. Can perform a limited number of different operations efficiently. 

□ 3. Can perform several different operations with reasonable efficiency. 

□ 4. Can perform many different operations effldently. 

□ S. Can perform an unusually large variety of different operations effkiently. 

F. ConsiderirM afi the factors already rated, and only these factors, how good is this worker? (Worker*s all-around 
ab^ to do the job.) 

G 1 . Performance usually not acceptable. 
O 2. ^rformance somewhat inferior. 
D 3 A fairly proficient worker. 
O 4. ^formance uaially superior. 
O 5. An unusually competent worker. 

Compkte the foOowtng ONLY if the worker no longer on the job. 

G. What do you thikix is the reaaon this peraon left the job? (h ci not necessary to show the official reaaon if you 
feel that theie is another reaaon. as tms form will not be shown to anybody in the company.) 

□ I. FM because of inability to do the job. 

□ 2. Quit, and i feel that it was because of ^fflcuhy domg the job. 

□ 3. Fired or laid off for reaaons other than abiity to do the job O-^** absenteeism, reduction in force). 

□ 4. Quit. Mtd I fM the reason for qvittkic was not related to ability to do the job. 

□ S. Quit or was promoted or rmaigned because the worker had learned the job weB and wanted to advance. 
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APPENDIX 3 



JOB DESCRIPTION 



Job Title 

CUSTOMER-SERVICE REPRESENTATIVE (light, heat & power; tel. and tel.; 
waterworks) 239,367-010 



Guide for Occupational Exploration (GOE) 07,04,01; Interviewing. 



Job SuiTinary 

Talks with customers by phone or in person to receive orders for 
installation, discontinuance, or change in water, gas, electric, or telephone 
services. 



Work Performed 

*Talks with customers by phone or in person to receive orders for 
installation, discontinuance, or change in services: Quotes costs and rates 
for various services. Questions customers to obtain information required to 
initiate installation or discontinuance of services. Writes obtained 
information on form designated for specific order given by customer. Reviews 
written form for accuracy and con^)leteness. Routes forms to proper person or 
department for implemen^tion of orders. 

^Questions customers to obtain information on changes in billing address: 
Corrects company records according to office procedure. Corrects customer 
records by writing address change on record or typing change on computer 
terminal keyboard. 

May investigate and resolve customer complaints regarding billing or service 
rendered. Refers unresolved complaints to Customer Representative. 



♦These job duties were designated as critical job duties because they must be 
performed competently if the job is to be performed in a satisfactory manner. 
Customer-Service Representatives spend about 80% of their working time 
performing these duties. 



